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ABSTRACT 


The  filter  design  problem  is  considered  as  an  optimization  problem. 
An  iterative  search  technique  is  employed  to  adjust  the  variable  net¬ 
work  element  values  to  approximate  some  desired  network  response,  with 
a  minimum  of  error.  Explicit  constraints  are  employed  to  ensure 
physical  realizability.  The  design  process  uses  a  combination  of  a 
modified  version  of  Calahan's  network  analysis  program  with  a  direct 
search  method  of  minimization  developed  by  Hooke  and  Jeeves.  The 
result  is  a  procedure  which  utilizes  the  circuit  designer's  experience 
and  knowledge  to  set  up  the  problem  but  relieves  him  of  the  tedious 
labor  now  performed  by  the  high-speed  digital  computer. 
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I.  INTRODUCTION 


A.  COMPUTER-AIDED  NETWORK  DESIGN 

Mathematical  programming  techniques  have  found  wide  use  in  operations 
research,  econom  .cs ,  and  other  related  fields.  However,  it  has  only  been 
in  recent  years  that  such  techniques  have  gained  acceptance  as  tools  for 
the  design  and  evaluation  of  electronic  circuits.  The  development  of 
several  general  network-analysis  programs  has  made  computer-aided  net¬ 
work  design  quite  attractive.  What  is  computer-aided  network  design? 

The  circuit  operation  is  first  analyzed  by  means  of  a  computer.  It  is 
then  modified  and  analyzed  again  until  the  desired  result  is  achieved— a 
trial-and-error  procedure.  Naturally  the  more  experienced  the  engineer, 
the  fewer  the  trials  before  a  satisfactory  design  is  realized. 

The  engineer  today  has  a  variety  of  analysis  programs  which  may 
suit  his  needs  in  the  design  of  networks.  Some  of  the  more  well-known 
ones  are:  NET-1,  ECAP,  SCEPTRE,  NASAP,  CIRCUS,  LISA,  PANE,  CALAHAN, 
and  CORNAP.  Programs  such  as  these  have  offered  great  assistance  to 
the  engineer  in  the  aualysis  and  design  of  networks.  Although  the 
obvious  advantages  in  saving  of  time  and  tedious  labor  are  quite 
apparent,  there  are  certain  features  that  would  be  desirable  and 
perhaps  possible  in  future  programs  of  the  type  mentioned.  Some  of 
these  features  may  include: 

1.  A  graphical  output  on  remote  terminals  which  will  allow  the 
engineer  to  check  his  results  and  make  on  the  spot  changes  as  necessary. 

2.  Automatic  means  for  improving  the  circuit  design;  i.e.,  some 
optimization  technique  to  obtain  "best"  element  values. 
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As  valuable  an  aid  as  the  computer  is,  a  significant  part  of  the 
design  procedure  will  still  require  the  engineering  judgement  of  the 
designer.  The  cost  for  relieving  the  engineer  of  all  the  tedious  calcu¬ 
lations  required  for  analysis  is  not  an  inexpensive  one.  The  engineer 
must  use  his  knowledge  to  specify  the  network  topology,  the  response 
desired,  constraints  on  element  values,  error  criteria,  reasonable 
initial  element  values,  and  other  information  which  only  he  can  provide. 

B.  USE  OF  OPTIMIZATION  TECHNIQUES  IN  COMPUTER-AIDED  NETWORK  DESIGN 

The  network  designer  is  basically  confronted  with  the  problem  of 
designing  a  circuit  to  meet  some  prescribed  performance  requirements. 

The  design  may  be  accomplished  in  one  of  many  ways.  If  the  requirements 
are  such  that  an  existing  synthesis  technique  will  provide  the  answer, 
the  problem  is  essentially  solved,  and  a  satisfactory  solution  is  obtained. 
In  some  caces  a  perfectly  good  design  may  be  achieved  in  the  laboratory 
by  physically  wiring  the  circuit  on  the  "bread-board"  and  experimentally 
determining  the  "best"  element  values  for  the  design. 

There  are  classical  synthesis  techniques  which  provide  a  step-by- 
step  design  procedure,  resulting  in  the  circuit  configuration  and 
element  values  [1],  However,  there  are  some  design  problems  which  may 
not  be  amenable  to  solution  by  any  of  the  known  synthesis  techniques. 

The  designer  may  be  given  a  requirement  in  the  form  of  a  table  of  values 
or  a  graph  of  the  response  desired.  Such  a  requirement  cannot  be  satis¬ 
fied  by  the  classical  synthesis  techniques.  If  the  circuit  contains  a 
large  number  of  variable  elements,  design  by  a  trial-and-error  process 
in  the  laboratory  is  also  highly  unfeasible.  Again,  as  with  the  analysis, 
the  high-speed  digital  computer  has  offered  an  alternative  approach  to 
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the  problem.  We  can  now  use  some  optimization  technique  to  find  element 
values  in  a  given  design  configuration  which  yield  a  solution  nearest 
to  the  prescribed  performance  requirement.  The  optimization  technique 
iteratively  adjusts  the  element  values  until  the  requirement  is  approxi¬ 
mated  as  closely  as  possible. 

Although  synthesis  techniques  are  available  for  the  design  of 
standard  high-  and  low-pass  filters,  they  do  not  take  into  accunt  any 
constraints  on  the  network  configuration  or  element  values.  Problems 
of  this  nature  would  certainly  be  amenable  to  solution  by  an  optimi¬ 
zation  technique-.  Nctvcrks  whose  transfer  functions  are  extremely 
complex  comprise  another  class  of  problems  which  could  be  solved  by 
optimization.  Optimization  may  also  be  used  to  obtain  models  for  accive 
devices.  An  optimization  scheme  could  well  be  used  in  the  design  of 
matched  filters.  There  are  countless  other  examples,  but  suffice  it  to 
say  that  a  combination  of  a  good  network  analysis  program  and  an 
efficient  optimization  program  is  certainly  an  excellent  application 
of  computer-aided  network  design. 

C.  OPTIMIZATION  TECHNIQUES 

In  any  optimization  procedure  two  requirements  must  be  satisfied. 
First,  there  must  be  some  means  to  determine  the  behavior  or  performance 
of  the  system  for  any  set  of  parameter  values.  Second,  a  performance 
measure  must  be  selected  which  is  a  numerical  measure  of  the  behavior 
of  the  system.  rhe  optimization  is  basically  a  matter  of  minimising 
the  performance  measure,  which  is  a  function  of  the  parameters.  If  we 
think  of  this  in  geometric  terms ,  the  points  in  the  parameter  space 
represent  different  circuit  element  values  and  any  change  in  the  element 
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value  will  result  in  movement  to  another  point  in  the  space.  The  per¬ 
formance  measure  is  defined  on  this  parameter  space  and  requires  an 
additional  dimension  if  it  is  to  be  represented  geometrically. 

Minimization  techniques  generally  do  not  yield  the  global  minimum. 
What  is  found  is  a  local  minimum,  but  by  changing  the  starting  values 
of  the  parameters,  it  can  be  determined  whether  the  local  minimum  is 
also  the  global  minimum.  If  the  minimization  procedure  converges  to 
different  values  of  the  performance  measure,  the  smallest  value  of  the 
performance  measure  is  then  selected  as  the  global  minimum.  The  dif¬ 
ferent  minimization  techniques  may  be  classified  by  the  method  which 
is  utilized  to  find  a  local  minimum.  They  may  be  generally  classified 
in  the  three  following  categories: 

1.  Direct  search  methods:  those  which  do  not  compute  the  partial 
derivatives  of  the  performance  measure  with  respect  to  the  parameters, 
but  use  only  the  value  of  the  performance  measure. 

2.  Gradient  methods:  those  which  require  the  calculation  of  the 
first  partial  derivatives  of  the  performance  measure  with  respect  to 
the  parameters. 

3.  Second-Order  methods:  those  requiring  higher-order  partial 
derivatives. 

No  attempt  will  be  made  here  to  discuss  the  various  methods  under 
each  category.  An  excellent  discussion  of  the  methods  can  be  found  in 
Ref.  [2]. 

D.  THE  GENERAL  NATURE  OF  THE  PROBLEM 

Earlier  it  was  stated  that  for  problems  which  cannot  be  solved  by 
existing  synthesis  techniques  or  by  experimenting  with  the  circuit,  an 
optimization  technique  may  be  feasible  as  an  alternative  solution. 
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Problems  which  are  amenable  to  solution  by  optimization  will  generally 
be  stated  as  follows:  "Given  a  particular  network  with  a  fixed  number 
of  variable  elements,  adjust  these  elements  until  the  response  of  the 
network  minimizes  some  preassigned  criterion".  The  key  words  in  this 
general  statement  are  "particular  network  with  a  fixed  number  of  vari¬ 
able  elements".  For  a  particular  desired  response  there  may  be  several 
network  configurations  ’diich  will  yield  comparable  results.  The  job  of 
the  designer  then  is  to  choose  among  the  configurations  he  tries,  and 
to  select  the  best  design  which  satisfies  the  requirements.  One  of  the 
desirable  features  the  engineer  would  like  in  future  programs  for  com¬ 
puter-aided  design  is  the  ability  of  the  program  to  also  produce  the 
network  configuration  as  well  as  the  element  values  for  the  optimal 
network  for  a  given  response.  With  the  existing  programs  the  engineer 
starts  with  a  particular  network  configuration  and  a  fixed  number  of 
variable  elements  are  adjusted  until  the  performance  meets  some  pre¬ 
assigned  criterion. 

Now  that  the  type  of  design  problem  is  defined,  the  important 
features  of  the  optimization  process  may  be  studied.  Figure  1-1 
gives  the  essential  elements  which  should  be  a  part  of  the  optimization 
technique  for  the  circuit  design  problems. 

The  choice  of  the  network  configuration  and  the  initial  element 
values  is  the  task  of  the  engineer  before  the  actual  optimization 
process  begins.  The  features  to  be  discussed  now  are  the  evaluation 
of  the  response,  the  performance  measure  and  the  decision-making 
process . 

The  first  thing  the  optimization  program  must  be  capable  of  doing 
is  to  evaluate  the  response  from  a  given  set  of  element  values.  This 
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Fig.  1-1  The  Optimization  Process 

must  be  done  each  time  the  element  values  are  adjusted.  The  analysis 
programs  mentioned  above  all  have  this  capability. 

Once  the  response  has  been  evaluated,  it  must  be  compared  with  the 
desired  response.  The  measure  of  behavior  is  the  performance  measure. 

It  is  impossible  to  choose  a  single  criterion  and  call  it  the  universal 
performance  measure.  The  nature  of  the  problem  may  determine  what  per¬ 
formance  measure  is  to  be  used.  The  experienced  circuit  designer  will 
generally  have  in  mind  what  performance  measure  is  best  for  a  given 
situation.  The  performance  measure  chosen  must  remain  the  same  throughout 
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the  design  procedure.  Some  problems  will  dictate  what  performance 
measure  is  to  be  used,  but  in  many  cases  the  choice  is  purely  subjective 
(3  J. 

There  are  several  typical  forms  of  the  performance  measure  the 
designer  may  use  io  the  optimization  process.  The  simplest  form  would 
be 

j(p>  -  !ra  ^  (ft)| 

where  3(g)  is  the  performance  measure,  a  function  of  the  parameter 
values  £,  the  terms  (f^)  and  (f,)  represent  the  actual  and  desired 
frequency  responses,  respectively,  and  N  is  the  total  number  of  points. 
This  form  of  the  performance  measure  indicates  that  only  the  magnitude 
of  the  difference  is  of  interest,  positive  and  negative  deviations 
having  equal  weight.  Another  performance  measure  is 

J<e>  -  ",  i>A  (fi>  -  %  <fi>r 

1=1 

where  n  is  some  even  integer.  When  the  difference  between  the  actual 
and  desired  responses  are  small,  say  less  than  1.0,  then  the  value  of 
this  performance  measure  will  decrease  with  increasing  values  of  the 
exponent,  n.  These  are  just  two  examples  of  what  may  be  used  for 
performance  measures.  By  defining  the  performance  measure  In  some  way 
such  as  mentioned  above,  the  optimization  procedure  is  one  in  which  a 
search  is  conducted  to  find  the  minimum  of  the  performance  measure. 

The  search  for  this  minimum  generally  results  in  finding  a  local 
minimum  as  mentioned  above.  Only  if  it  is  known  that  the  function  is 
unimodal  will  the  local  minimum  be  the  global  minimum.  Otherwise,  it 
is  necessary  to  conduct  a  systematic  search  of  the  entire  parameter 


13 


- - - 


I 


space  in  order  to  locate  the  global  minimum.  For  problems  that  ha\e 
more  than  three  or  four  variable  parameters  this  may  not  be  feasible. 
However,  if  the  search  is  started  with  new  initial  values  of  the 
elements,  and  the  function  value  converges  to  the  same  value,  then  one 
can  be  relatively  certain  that  a  global  minimum  has  been  located.  By 
finding  a  minimum,  whether  it  be  local  or  global,  a  perfectly  acceptable 
solution  may  be  obtained.  In  the  final  analysis,  it  is  the  engineers 
decision  whether  the  final  network  configuration  behaves  in  a  satis¬ 
factory  manner  or  whether  further  investigation  is  necessary  to  locate 
a  "better"  minimum. 

This  final  aspect,  the  decision  of  the  engineer,  is  perhaps  the  most 
critical  item  in  the  optimization.  He  must  weigh  the  cost  of  further 
exploration  to  find  a  smaller  minimum  against  the  solution  he  already 
has.  A  great  deal  depends  on  what  the  circuit  requirements  are.  The 
tolerances  on  the  element  values  may  be  such  that  the  procedure  may 
have  to  be  repeated  again  and  again.  On  the  other  hand,  there  may  be 
very  weak  restrictions  on  the  element  values  so  long  as  the  response 
matches  the  desired  response  within  say  0.156.  The  computer  relieves 
the  engineer  of  the  tedious  work  involved  in  any  optimization  procedure, 
but  l>e  is  still  responsible  for  making  the  knowledgable  decisions  to 
use  the  computer  most  advantageously. 
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II.  THE  OPTIMIZATION  PROGRAM 


A.  ANALYSIS  PROGRAM 

As  mentioned  in  Chapter  I,  the  optimization  procedures  will 
include  an  analysis  program  and  a  minimization  program.  Among  the 
various  programs  available,  the  CAIAHAN  and  ECAP  programs  were  con¬ 
sidered  as  likely  choices.  Both  programs  were  subjects  of  study  in 
a  course  in  computer-aided  design,  taught  by  Professor  S.  G.  Chan, 
offered  at  the  Naval  Postgraduate  School.  The  CAIAHAN  program  was  the 
final  choice  since  it  provides  for  a  graphical  output  of  the  frequency 
response,  an  output  not  available  with  ECAP.  Presumably  the  engineer 
who  is  designing  by  optimization  will  either  choose  a  program  which  he 
has  used  successfully,  or  he  will  write  a  program  to  suit  his  needs. 

1.  A  Linear  Network  Analysis  Progra.; 

The  CAIAHAN  program  is  a  general-purpose  program  designed  for 
the  analysis  of  linear  electrical  networks  [4].  Input  data  to  the 
program  consists  of  the  number  of  nodes  in  the  circuit,  the  number  of 
passive  elements,  the  number  of  active  elements,  the  input  and  output 
node  numbers,  and  the  type  of  output  desired.  A  list  of  element  values 
must  be  provided  as  well  as  a  range  of  values  of  frequency  (time)  over 
which  the  frequency  (transient)  response  is  to  be  calculated.  Outputs 
from  the  program  are  the  coefficients  of  the  specified  network  function, 
the  poles  and  zeros,  frequency  and/or  transient  responses.  Hie  program 
is  designed  so  that  the  user  need  only  provide  the  required  data  cards , 
to  obtain  the  desired  output. 


2 .  Modification  of  CALAHAN  for  Use  in  the  Optimization  Program 


In  order  to  incorporate  CALAHAN  into  the  optimization  program, 
it  was  necessary  to  make  some  modifications  to  the  original  CAIAHAN 
program.  Before  this  was  done,  the  original  version  was  run  a  con¬ 
siderable  number  of  times  to  yield  frequency  responses  of  circuits 
for  which  the  actual  responses  were  known.  From  the  closed-form 
expression  of  the  voltage  transfer  function  of  the  Butterworth  filter 
[5],  the  theoretical  frequency  responses  were  obtained  for  various 
orders  of  this  type  of  filter.  Using  values  of  the  normalized 
Butterworth  filters  [6],  frequency  responses  were  calculated  by 
CAIAHAN  for  different  orders  of  the  filter.  The  responses  calcu¬ 
lated  by  CAIAHAN  were  almost  exactly  the  same  as  the  theoretical 

-  i  * 

responses.  The  procedure  was  also  repeated  with  the  Chebyshev  filter 

and  similarly  good  results  were  obtained. 

Since  the  goal  of  the  optimization  is  to  determine  a  set  of 

element  values  for  a  particular  network  configuration  whose  frequency 
* 

response  is  to  match  a  given  response  as  closely  as  possible,  only  the 
portion  of  CAIAHAN  that  calculates  the  frequency  response  is  needed. 

The  main  program  from  the  original  CAIAHAN  was  reduced  until  only  the 
portions  involving  the  frequency  response  remained.  Several  subroutines 
that  are  not  essential  to  the  calculation  of  the  frequency  response 
were  removed. 

B.  THE  MINIMIZATION  PROGRAM 

The  minimization  program  used  in  conjunction  with  CAIAHAN  to  form 
the  optimization  program  is  a  direct  search  technique  [7].  This 
category  of  minimization  techniques  requires  only  the  calculation  of 
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the  value  of  the  performance  measure,  the  calculation  of  derivatives 
not  being  a  requirement.  A  gradient  technique  used  in  the  design  of 
filters  by  optimization  is  the  subject  of  the  Naval  Postgraduate  School 
thesis  written  by  Major  Charles  A.  Henry,  USMC.  Results  obtained  using 
the  two  methods  are  discussed  and  compared  in  Chapter  IV. 

1.  Direct  Search 

Direct  search  may  be  basically  described  as  a  sequential 
examination  of  trial  solutions  which  involves  the  comparison  of  the 
trial  solution  with  the  "best"  solution  obtained  up  to  that  time  and 
a  method  for  determining  what  the  next  trial  solution  will  be  [7]. 

Among  the  various  types  of  problems  which  can  be  solved  by  direct 
search  are  solution  of  system  of  equations,  curve-fitting  problems, 
solution  of  integral  equations,  and  minimizing  (or  maximizing) 
functions  with  or  without  constraints  on  the  variables.  The  application 
of  direct  search  methods  to  the  solution  of  problems  of  the  types 
mentioned  above  is  basically  the  same  regardless  of  the  type  of  problem. 

A  space  of  P  points,  representing  the  solution  space,  must  be 
defined.  There  must  be  some  means  to  determine  that  one  point  is 
"better"  than  another.  Presumably  there  is  a  "best"  solution  P*  in 
the  solution  space.  Direct  search  is  then  accomplished  in  the  following 
manner:  A  point  B^,  designated  the  first  base  point,  is  arbitrarily 
selected  in  the  space.  A  second  point,  Pg,  is  then  selected  and  com¬ 
pared  with  B^.  If  P,  is  "better”  than  B^  then  ^  becomes  82*  the 
second  base  point.  However  if  P2  is  not  "better"  than  B^,  then  8^ 
remains  the  base  point.  The  process  continues  with  each  new  point 
selected  and  compared  with  the  current  base  point.  The  technique  for 
selecting  new  trial  points  is  determined  by  various  conditions  which 
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arise  as  a  function  of  results  of  trials  made.  The  technique  to  be 


used  in  the  minimization  program  is  pattern  search. 

2 .  The  Specific  Technique--Patcarn  Search 

Pattern  search  is  a  direct  search  technique  for  finding  the 

T 

minimum  of  a  function  F(j>)of  the  variables  £  =  (p.  ,  p^,  p^»  . -.,p^)  • 
The  argument  £  is  varied  until  a  minimum  value  of 
The  successive  values  of  p  represent  points  in  an  N-dimensional  space. 

The  operation  of  the  pattern-search  routine  will  now  be 
described.  First,  a  few  definitions  will  be  of  aid  in  the  ensuing 
discussion.  The  procedure  of  going  from  one  point  to  another  point 
is  termed  a  move .  If  the  value  of  F(p)  decreases,  then  the  move  is  a 
success ;  if  tha  function  F(j>)  does  not  decrease,  then  che  move  is  a 
failure.  Pattern  search  makes  two  types  of  moves.  The  explore  move 
Is  to  acquire  knowledge  about  the  behavior  of  the  function  F(j>) .  The 
second  type  of  move  is  the  pattern  move  which  utilizes  the  information 
gfained  from  the  explore  moves  to  accomplish  the  actual  minimization  of 
the  function  by  moving  in  the  direction  of  an  established  pattern.  The 
point  from  which  a  pattern  move  is  made  is  known  as  a  base  point . 
Basically  the  pattern-search  procedure  is  movement  from  base  point  to 
base  point. 

The  explore  move  provides  the  information  which  indicates  a 
probable  direction  for  a  successful  move.  A  pattern  is  thus  estab¬ 
lished.  The  pattern  move  from  a  given  ba? e  point  duplicates  the 
combined  moves  from  a  previous  base  point  if  the  direction  of  the 
pattern  is  unchanged.  This  process  continues  as  long  as  the  moves 
arfe  successful,  the  step  lengths  increasing  in  magnitude.  The  result 
of  each  pattern  move  then  is  either  a  success  or  a  failure.  If  the 


F(p)  is  obtained. 
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pattern  move  is  a  success,  then  a  series  of  explore  moves  is  carried  out 
to  see  if  the  result  can  be  further  improved. 

Each  explore  move  is  carried  out  in  the  following  manner:  a 
single  coordinate  of  the  point  is  varied  by  either  increasing  or 
decreasing  the  coordinate  by  some  fixed  amount  and  seeing  if  the  move 
is  a  success.  If  a  success  occurs,  the  new  coordinate  value  is  used; 
otherwise  the  old  coordinate  is  retained.  For  each  coordinate,  these 
explore  moves  are  made  until  the  final  point,  as  a  result  of  all  the 
explore  moves,  becomes  the  new  base  point. 

If,  on  the  other  hand,  the  pattern  move  is  a  failure,  the  search 
continues  by  retreating  to  the  base  point  and  starting  over  again  with 
new  explore  moves  until  a  new  pattern  is  established. 

Hie  pattern-search  technique  can  be  better  understood  with  the 
aid  of  a  simple  example.  Figure  II-l  serves  as  an  illustration  of  what 
has  been  discussed  in  the  previous  paragraphs.  A  two-dimensional  para¬ 
meter  space  is  shown  with  equal-cost  contours  represented  by  F^,  F^, 

...,  Fgj  where  >  Fj^.  The  argument  of  the  function  F  is  p  *  (Pj^Pj) 
The  point  is  selected  as  the  first  base  point  and  explore  moves  are 
conducted  from  this  point.  First  the  coordinate  is  stepped  in  its 
positive  and  negative  directions ;  a  success  is  achieved  when  the  step 
is  negative.  Next  the  p^  coordinate  is  tested  and  it  is  determined 
that  a  positi/e  step  yields  a  success.  The  explore  move  produces  a 
new  base  point  B2.  The  most  probable  direction  of  a  success  is  in  the 
direction  of  the  line  segment  B.^;  therefore,  the  pattern  is  estab¬ 
lished  and  the  pattern  move  results  in  TP^,  a  temporary  point.  Each 
pattern  move  is  followed  by  a  series  of  explore  moves.  If  the  result 
of  the  explore  moves  is  a  success,  then  the  pattern  move  is  termed  a 


success.  The  point  resulting  from  the  successful  '••plore  moves  becomes 
the  new  base  point.  If,  however,  the  explore  moves  are  failures,  the 
function  value  at  the  temporary  point  is  calculated  and  if  this  value 
is  greater  than  the  function  value  at  the  previous  base  point,  the  old 
base  point  becomes  the  new  base  point  and  explore  moves  are  tried  again. 
At  TPj  explore  trials  are  made  and  a  successful  move  is  made  to 
which  becomes  the  new  base  point.  This  indicates  that  the  pattern  move 
to  TP^  was  a  success.  By  the  same  line  of  reasoning,  the  pattern  move 
to  T?2  is  a  success.  The  pattern  move  to  TP^  is  a  failure  since  all 
explore  moves  from  this  point  are  failures  and  the  value  of  the  function 
at  TP^  is  greater  than  the  value  at  therefore  becomes  8j,  the  new 
hase  point,  and  the  explore  moves  are  tried  again.  The  region  within 

-•v- 

the  F_  contour  is  enlarged  by  a  factor  of  five  and  shown  in  Pig.  11-2. 

O 

The  point  B^  is  a  successful  explore  but  it  should  be  noted  that  there 
is  no  change  in  the  p2  coordinate  from  B^.  A  change  in  the  p^  coordi¬ 
nate  would  yield  a  failure.  The  pattern  move  to  TP^  is  a  failure,  so 
now  becomes  B^  and  explore  moves  are  made.  Perturbations  of  both 
Pj,  and  P2  in  the  original  step  size  do  net  produce  any  successful 
explore  moves.  It  is,  therefore,  necessary  to  reduce  the  step  size 
by  some  fixed  amount.  The  step  reduction  factor  in  this  case  is  0.2, 
which  means  that  the  original  step  size  has  new  been  reduced  by  a 
factor  of  five.  Once  again  explore  trials  are  made,  now  with  the  new 
step  size,  3nd  a  success  is  achieved  at  Bg.  The  pattern  move  to  TP^ 
is  a  failure,  so  Bg  becomes  B^.  A  successful  explore  move  is  achieved 
at  but  the  pattern  move  to  TP^  is  a  failure  and  B^  becomes  Sjj. 

This  process  of  reducing  the  step  size  and  then  making  the  pattern  moves 
continues  until  the  difference  between  two  consecutive  steps  is  less  than 
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some  prescribed  amount-  If  this  criterion  is  a  very  small  number  then 
the  step  size  will  be  sufficiently  small  to  ensure  that  the  minimum  has 
been  closely  approximated-  Care  must  be  takes  in  the  choice  of  both  the 
step  size  and  the  step  reduction  factor.  Too  large  a  redaction  factor 
will  result  in  a  slowdown  of  the  search  procedure.  If  an  initial  step 
size  is  too  large,  the  minimum  may  be  missed  altogether. 

The  direct  search  procedure  described  above  is  termed  pattern 
search  since  the  minimization  is  basically  performed  by  the  pattern 
moves.  Although  the  explore  moves  provide  some  reduction,  their  mate 
purpose  is  to  provide  information  for  the  improvement  of  the  pattern 
move.  The  pattern -search  program  used  in  the  optimization  program  Is  a 
program  written  by  &.  Hrllaary^,  with  sow  modifications  to  i  me  lode  con¬ 
straints  on  the  independent  variables. 

C.  THE  OPTDUZATKW  PROGRAM-  -A  COMBINATION 

In  sections  A  and  B  the  individual  programs  in  the  optimization 
program  were  discussed  in  some  detail.  A  brief  description  was  given 
of  the  modifications  to  CAIAHAN  to  accommodate  the  particular  problems 
to  be  considered.  How  are  CAIAHAN  and  DIRECT  together  to  be  imple¬ 
mented  into  one  program  to  be  used  in  the  design  of  networks  by  optimi¬ 
zation?  The  answer  to  this  question  is  the  subject  of  this  section. 

The  basic  type  of  filter  design  problem  which  will  be  solved  by  the 
optimization  program  is  tme  in  which  a  particular  frequency  response  is 
given  and  the  objective  is  to  design  a  filter  which  approximates  the 
response  as  closely  as  possible.  In  the  next  chapter  the  exact  problem 
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problem  formulation  and  specific  example  problems  will  be  discussed  in 
detail,  but  the  above  problem  description  is  adequate  for  a  general 
discussion  of  the  optimization  program.  After  the  particular  circuit 
has  been  selected,  a  choice  of  initial  element  values  must  be  made,  the 
engineer's  knowledge  and  experience  playing  a  vital  role  in  the  choice. 
Other  information  which  must  be  supplied  to  the  program  includes  the 
following:  the  number  of  frequency  points  to  be  matched,  the  values  of 
the  desired  frequency  response  at  the  points  to  be  matched,  the  explici 
constraints  on  the  element  values,  the  step  size,  the  step  reduction 
factor,  and  the  termination  criterion  for  the  minimization. 

The  initial  element  values  serve  as  coordinates  of  the  first  base 
point  for  the  pattern  search  routine,  called  DIRECT.  An  external 
function  subprogram  then  calculates  the  value  of  the  function  to  be 
minimized  by  DIRECT.  The  exact  form  of  this  function  may  differ  for 
different  problems,  but  in  all  cases  it  is  a  comparison  between  the 
actual  frequency  response  and  the  desired  response.  This  calculation 
is  performed  as  part  of  the  function  subprogram  utilizing  the  modified 
version  of  CALAHAN.  Otce  the  minimum  has  been  determined,  the  element 
values  producing  the  minimum  are  supplied  to  the  analysis  program  and 
the  actual  frequency  response  is  calculated.  This  process  may  be 
repeated  until  the  overall  design  satisfies  all  of  the  requirements. 


III.  IMPLEMENTATION  OF  THE  OPTIMIZATION  PROGRAM 


The  use  of  the  optimization  program  is  dictated  by  the  requirements 
for  the  design.  An  optimization  technique  should  be  used  only  when 
classical  synthesis  methods  and  experimental  methods  are  either  impos¬ 
sible  or  unfeasible.  The  purpose  of  this  chapter  is  to  discuss  the  use 
of  the  optimization  program  in  circuit  design.  The  first  section  of  the 
chapter  is  a  general  discuision  of  the  features  of  the  program.  In  the 
concluding  section  several  examples  are  given  to  illustrate  the  use  of 
the  program. 

A.  PROGRAM  FEATURES 

1.  The  Input  Date 

For  input  data,  the  optimization  program  requires  a  topological 
description  of  the  network,  a  list  of  element  values,  a  range  of 
frequencies  over  which  the  desired  and  actual  responses  are  to  be 
matched,  a  description  of  the  desired  response,  the  number  of  varying 
and  non-varying  elements,  and  a  list  of  the  constraints  on  the  varying 
elements.  The  following  information  required  by  DIRECT  must  also  be 
included  in  the  input  data:  the  step  size,  the  step  reduction  factor, 
the  termination  criterion,  and  the  maximum  allowable  number  of  evalu¬ 
ations.  Figure  Ill-lis  a  flow  chart  showing  the  sequence  and  coding  of 
the  input  data  cards. 

2 .  The  Output 

The  output  from  the  optimization  program  consists  of  two  parts. 
The  first  part  is  a  result  of  the  minimization  and  includes  the  value 
of  the  function  at  convergence,  and  the  optimum  values  of  the  variable 
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Fig.  III-l  Coding  Flew  Chart  for  Optimization  Program 
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elements-  The  second  part  of  the  output  is  a  result  of  the  analysis 
program.  With  the  optimum  element  values  calculated  by  DIRECT,  the 
frequency  response  is  calculated.  The  output  is  in  tabular  font  as  well 
as  in  a  graphical  form.  The  circuit  designer  merely  compares  the  values 
of  the  calculated  response  with  those  of  the  desired  response.  If  the 
design  requirements  are  satisfied,  the  element  values  calculated  in  the 
first  part  of  the  output  are  the  element  values  of  the  design. 

3 .  Accuracy  of  the  Optimization  Program 

In  all  examples  used  in  testing  the  program,  the  performance 
measure  to  be  minimized  was  of  the  form. 


where  J(p)  is  a  function  of  the  network  elements  p.  R  (f.)  is  the 

— 1  ~  A  r 

actual  frequency  response  at  the  ifc^  comparison  point  and  ^  (f^)  is 
the  desired  response  at  the  same  point  of  comparison.  H  is  the  total 
number  of  frequency  points  to  be  compared  and  n  is  some  even  integer. 
Theoretically,  the  minimum  of  this  performance  measure  is  xer«  If  a 
perfect  match  of  frequency  responses  is  achieved.  In  practice,  however, 
a  zero  output  is  rarely,  if  ever,  achieved.  The  measure  of  accuracy  is 
determined  by  the  function  value  at  exit  from  DIRECT;  the  smaller  the 
function  value,  the  closer  the  actual  response  approaches  the  desired 
response. 

The  accuracy  of  the  output  is  basically  dependent  upon  the 
choice  of  the  termination  criterion  for  DIRECT.  The  pattern  search 
ends  when  the  difference  between  consecutive  step  sizes  falls  below 
this  pre-selected  termination  criterion.  A  small  criterion  will  result 
in  a  small  function  value,  consequently  a  closer  approximation  to  the 


desired  response.  The  program  allows  the  user  to  specify  the  termination 
criterion  as  part  of  the  input.  Table  III-l  shows  a  comparison  of 
execution  times,  and  function  values,  for  a  normalized  fourth-order 
Butterworth  filter,  as  a  function  of  the  step  size,  the  step  reduction 
factor,  and  the  termination  criterion.  The  performance  measure  used  was 
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The  function  values  for  a  termination  criterion  of  10  differ  by  a 
factor  of  100  from  those  for  a  termination  criterion  of  10  **;  whereas 
the  difference  between  function  values  for  termination  criteria  10  ^  and 
10  is  insignificant.  In  this  case  there  is  no  particular  advantage  in 
the  choice  of  a  termination  criterion  less  than  10  since  the  function 
values  only  change  slightly  but  the  execution  times  are  longer.  A  com¬ 
parison  between  the  desired  response,  for  the  frequency  range  specified, 
and  the  largest  and  smallest  function  values  is  given  in  Table  III -2. 

4.  Execution  Time 

The  execution  time  for  the  program  is  dependent  on  sever  al 
factors  which  will  be  discussed  in  this  section.  The  initial  choice 
of  element  values  will  certainly  affect  the  execution  time;  if  the 
initial  guess  is  a  poor  choice  the  program  may  take  an  inordinate  amount 
of  .time  if  it  converges  at  all  to  a  minimum.  Convergence  to  a  minimum 
also  may  be  quite  slow  for  circuits  with  a  large  number  of  elements. 

The  only  solution  to  this  problem  is  to  choose  a  simpler  circuit  con¬ 
figuration  which  may  yield  a  response  within  acceptable  tolerances.  In 
the  pattern  search,  the  execution  time  is  a  function  of  the  termination 
criterion.  The  choice  of  the  termination  criterion  is  a  compromise 
between  speed  and  accuracy;  one  is  sacrificed  for  the  other.  If  more 
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TABLE  III- 


Trial 

Step 

Size 

Step  Red. 
Factor 

Termination 

Criterion 

Execution 
Time  (Sec) 

Function 
Value  x  10' 

A 

0.05 

0.25 

10“4 

50.38 

203.67 

B 

0.05 

0.25 

io"e 

68.30 

0.31191 

C 

C.05 

0.25 

io'9 

78.01 

0.23612 

D 

0.05 

0.125 

10-4 

54.93 

105.01 

E 

0.05 

0.125 

10-6 

70.18 

0.1142* 

F 

0.05 

0.125 

-C- 
10  ' 

71.77 

0.11424 

G 

0.1 

0.25 

10'* 

46.37 

386  ,.91 

H 

0.1 

0.25 

v£> 

1 

O 

70.90 

0.55285 

I 

0.1 

0.25 

io'9 

78.D7 

0.54994 

J 

0.1 

0.125 

O 

1 

4> 

49.09 

60.625 

K 

0.1 

0.125 

io'6 

57.52 

7.753 

L 

0.1 

0.125 

O 

i 

63.03 

7.723 

M 

0.5 

0.25 

io'4 

68.27 

16.730 

N 

0.5 

0.25 

io"6 

87.31 

0.14581 

0 

0.5 

0.25 

io'9 

90.89 

0.14581 

P 

0.5 

0.125 

io'4 

85.22 

284.77 

Q 

0.5 

0.125 

io'6 

104.78 

0.12187 

R 

0.5 

0.125 

io'9 

110.14 

0.1218? 
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TABLE  III-2 


Desired 

Response 

-  0.1042320 

-  0.2204427 

-  0.4314420 

-  .0.7350979 

-  L. 330527 6 

-  2.1019602 

-  3.1032674 

-  4.3047100 

-  5.6547211 

-  .7.0972899 

-  8.5844102 
-10.0806382 
-11.5623696 
-13.0151248 
-14.4307494 
-15.8052081 
-17.1370394 
-18.4263366 
-19.6740983 
-20.8818219 
-22.0512536 


Trial  G 
Response 

-  0.1032002 

-  0.2196893 

-  0.4310329 

-  0.7850114 

-  1.3306713 

-  2.1021585 

-  3.1033316 

-  4.3045549 

-  5.6543064 

-  7.09b6568 

-  8.5836172 
-10.0797758 
-11.5614929 
-13.0142879 
-14.4300060 
-15.8045635 
-17.1365509 
-18.4259949 
-19.6738892 
-20.8817902 
-22.0513916 


Trial  F 
Response 

-  0.1042283 

-  0.2204416 

-  0.4314427 

-  0.7851012 

-  1.3305340 

-  2.1019697 

-  3.1032581 

-  4.3047056 

-  5.6547127 

-  7.0972862 

-  8.5844040 
-10.0806456 
-11.5623751 
-13.0151329 
-14.4307604 
-15.8052015 
-17.1370392 
-18.4263458 
-19.6740875 
-20.8818054 
-22.0512390 
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accurate  results  are  required  then  the  execution  time  is  necessarily 
longer.  Table  II1-1  shows  the  effects  of  different  step  reduction 
factors  and  termination  criteria.  A  further  comparison  of  execution 
time  as  a  function  of  the  number  of  points  compared  is  made  for  the 
normalized  fourth-order  Buttervorth  filter.  The  results  of  this  com¬ 
parison  are  shown  in  Table  1II-3. 

TABLE  IXI-3 


Points 

Execution  Time  (Sec) 

Function  Value 

50 

147.06 

0.8699953  x  10‘8 

40 

112.77 

0.4037205  x  10*7 

30 

33.93 

0.3040103  x  10‘8 

20 

71.77 

0.1142364  x  10‘8 

B.  DESIGN  EXAMPLES 

To  illustrate  the  use  of  the  optimization  program,  several  examples 
of  filter  design  will  be  discussed  in  this  section.  In  all  of  the 
examples ,  the  desired  frequency  response  is  in  the  form  of  a  table  of 
values.  These  values  are  to  be  matched  as  closely  as  possible  by  the 
circuit  configuration  selected.  In  general,  design  specifications  are 
not  quite  as  stringent  as  this.  A  more  likely  specification  would  be 
to  design  a  maximally  flat  filter  itt  a  pass  band  whose  cut-off 
frequencies  are  at  f^  and  an<^  with  a  dropoff  of  a  specified  number 
of  db  per  octave;  however,  to  illustrate  the  capability  of  the  program, 
point -by- point  comparisons  will  be  made. 
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Example  1  .... 

Problem:  Find  the  optimum  element  values  for  the  filter  con¬ 


figuration  shown  in  Fig.  III-2,  whose  frequency  response  from  0.15Hz 
to  0.24Hz  most  closely  approximates  the  S^-order  Butterworth  response 
over  the  same  range  of  frequencies. 


S 


Constraints  on  element  values 


0.5  <  Lx  <  1.75 


1.0  <  C2  <  2.5 


1.0  <  1^  <  1.6  R  *»  1.0 
0.4  <  C4  <  1.0 
0.1  <  1^  <  0.75 


Solution: 

Trial  1  Initial  guess:  •  Lj*1.0,  C^"2.0,  I*j»1.5,  C^*.8,  L,.*.5 

At  exit  from  program:  Lj*l,29,  02*2.12,  L^-1.19,  C^».888,  L^».16l 

Function  value  ■  .2435  x  10 

Trial  2  Initial  guess:  Lj»1.6,  02*2.0,  1^*1. 5,  C^*.8,  L,.*.5 

At  exit  from  program:  Lj*1.7,  02*1.5,  1^*1. 51,  C^*.875,  L^*.372 

Function  value  *  .6473  x  10  ^ 

Trial  3  Initial  guess:  Lj*l.6,  02*2.0,  Lj*1.5,  C^*.9,  L^*.5 

At  ex~».  from  program:  1^*1. 54,  02*1.7,  L,*1.38,  C^*.895,  L^*.307 

-13 

Function  value  *  .5150  x  10 


Trial  4  Initial  guess:  Lj*1.5,  02*2.0,  1^*1. 5,  C^».9,  Lj*.3 

At  exit  from  program:  Lj“1.43,  02*1.87,  1^*1. 29,  C^*.903,  L^».253 

Function  value  *  .1384  x  10  ^ 
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Trial  5  Initial  guess:  Lj=1.6,  C2=1.8,  1^=1. 5,  C^“.9,  L,.*.4 

At  exit  from  program:  L^=1.54,  ,  Lj=1.38,  C^=*.895,  ^*.307 

-13 

Function  value  —  .429  x  10 

The  optimum  element  values  are  those  values  calculated  in  trials  3  and 
5.  Comparison  of  the  trial  frequency  responses  with  the  Buttevworth 
response  is  shown  in  Table  III-4. 

Discussion — In  this  problem  only  ten  points  were  compared,  if  more 
accurate  results  are  desired  more  points  should  be  compared.  The  element 
values  for  trials  3  and  5  are  very  close  i.o  the  values  for  the  fifth 
order  normalized  Butterworth  filter. 
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Example  2 

Problem:  Design  a  filter  which  approximates  the  straight-line 
cl,a  race  fistic  shown  in  Pig.  III-4. 

Solution:  Select  the  circuit  configuration  by  determining  the  slope 
of  the  straight  line  after  cutoff.  The  slope  is  approximately  24db  per 
octave.  Each  6db/octave  represents  one  order  of  a  low-pass  filter; 
therefore  the  circuit  to  be  used  for  the  design  is  a  fourth-order  law- 
pass  filter  as  shown  in  Fig,  III-3, 
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Fig.  III-3  Circuit  for  Example  2 


Results : 


The  first  initial  guess: 

4=2.0, 

C2=2.0, 

4=2.0, 

C«2.0 

4 

At  exit  from  program: 

4=1.44,  C2=1.62, 

L,=1.10,  C. =0.379 
5  4 

The  second  initial  guess: 

4=1.5, 

C2=1.5, 

4=1.0, 

C4«0.5 

At  exit  from  program: 

4=1.44,  C2»1.63, 

4=1.10,  C4=0.381 

A  plot  of  the  actual  and  desired  responses  is  shown  in  Fig.  III-4. 
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Gain  (db) 


?REQ  (Hz) 


Fig.  III-4  Desired  aid  Actual  Responses  for  Example  2 
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Example  3 

Problem:  Design  a  filter  that  has  a  Gaussian  distribution  response 
in  the  frequency  range  from  0Hz  to  4Hz. 

Solution:  The  first  step  in  the  solution  is  to  change  the  Gaussian 
response  from  a  voltage  ratio  to  db  fcr  use  in  the  optimization  program. 
Table  III-5  contains  the  values  for  a  21-point  comparison.  The  response 
is  plotted  in  Fig.  III-5. 

The  first  trial  design  was  a  ninth-order  low-pass  filter.  The 
resulting  response  is  plotted  in  Fig.  III-5  showing  rather  marked 
deviations  from  the  desired  response.  At  the  lower  frequencies  the 
deviations  are  much  greater. 

The  second  trial  design  was  a  modified  fifth-order  low-pass 
filter.  The  response  is  plotted  in  Fig.  III-5.  There  is  a  slight 
improvement  in  the  approximation;  however  the  deviations  at  some  points 
are  quite  large. 

Discussion:  In  this  problem,  only  low-pass  filter  configurations 
were  considered.  Both  design  responses  deviated  considerably  from  the 
desired  responses.  This  points  out  a  limitation  of  the  optimization 
program.  Hie  success  of  the  optimization  technique  is  dependent  upon 
the  circuit  configuration  selected.  In  this  example,  presumably  there 
is  a  better  circuit  configuration  which  would  approximate  the  desired 
response  with  less  deviation. 


/ 
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TABLE! II -5 


Freq  ♦ 

Desired 

Gain 

Design  1 

Gain 

Design  2 
Gain 

0. 

0. 

0. 

0. 

0.2 

-  0.174 

0.389 

-  1.296 

0.4 

-  0.693 

1.827 

-  2.886 

0.6 

-  1.563 

1.172 

-  3.000 

0.8 

-  2.779 

-  3.918  ' 

-  1.969 

1.0 

-  4.341 

-  7.501 

-  3.687 

1.2 

-  d.253 

-  8.378 

-  8.179 

1.4 

-  8.512 

-  6.531 

-11.557 

1.6 

-11.119 

-10.683 

-13.150 

1.8 

-14.067 

-17.770 

-12.961 

2.0 

-17.368 

-22.048 

-14.552 

2.2 

-21.012 

-23.42} 

-21.813 

2.4 

-25.005 

-18.813 

-28.598 

2.6 

-29.345 

-22.974 

-34.113 

2.8 

-34.067 

-36.294 

-38.755 

3.0 

-39.172 

-44.084 

-42.794 

3.2 

-44.437 

-50.013 

-46.388 

3.4 

-50.458 

-54.899 

-49.640 

3.6 

-56.478 

-59.072 

-52.61S 

3.8 

-61.938 

-62.697 

-55.371 

4.0 

-70.458 

-65.865 

-57.933 
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FREQ  (Hz ) 

1.0  2.0  3.0  4.0 

i - 1 - 1 - r 


Fig.  III-5  Comparison  of  Two  Designs  with  the 
Gaussian  Response 
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Problem:  Design  a  simple  bandpass  filter  to  match  the  desired 
frequency  response  of  Table  III-6. 

Solution:  A  simple  th'rd-order  lev-pass  filter  is  transformed  ,'nto 
a  bandpass  filter  by  frequency  transformation.  The  resultant  circuit  is 
shown  in  Fig.  III-6. 


Fig.  III-6  Bandpass  Filter  Design 

Results : 

The  initial  guess:  C2*1.2,  C^»1.2,  L^*0.5,  L5»0,75,  C^-C.75 

Exit  from  program:  Lj-0.278,  C2*0.968,  C2»1.07,  L^*»0.231,  L5»0.512,  C^-0.5 
Results  are  tabulated  in  Table  XII-6. 


TABLE  III-6 

Ir-g£i 

Desired 

Gain 

Asctnal 

Gain 

0.12 

-10.6043971 

-10.6044772 

0.14 

-  7.8007050 

-  7 . 8000298 

0..16 

-  6.5953960 

-  6.5954428 

0.18 

-  6.1859341 

-  6.1866503 

0.20 

-  6.0634375 

-  6.0643120= 

0.22 

-  6.0301752 

-  6.0309124 

0.24 

-  6.0222807 

-  6.022790Q 

0.26 

-  6.0207853 

-  6.0211134 

0.28 

-  6.0205956 

-  6.0207987 

0.30 

-  6.0205870 

-  6.0207443 

0.32 

-  6.0205832 

-  6.0207691 

0.34 

-  6.0205908 

-  6.0208607 

0.36 

-  6.0206118 

-  6.0210257 

0.38 

-  6.0207939 

-  6.0213528 

0.40 

-  6.0214853 

-  6.0221939 

0.42 

-  6.0233574 

-  6.0242023 

0.44 

-  6.0275412 

-  6.0284853 

0.46 

-  6.0356464 

-  6.0366526 

0.48 

-  6.0498857 

-  6.0509090 

0.50 

-  6.0731249 

-  6.0740948 

0.52 

-  6.1088524 

-  6.1096964 

0.54 

-  6.1611710 

-  6.1618414 

0.65 

-  6.2347078 

-  6.2351713 

table  III-6  (continued) 


Freg. 

Desired 

udiU 

Actual 

Gain 

0.58 

-  6.3344698 

-  6.3346691 

0.60 

-  6.4655190 

-  6,4654360 

0.62 

-  6.6326761 

-  6.6323280 

0.64 

-  6.8401451 

-  6.8395615 

0.66 

-  7.0910606 

-  7.0902948 

0.68 

-  7.3872252 

-  7.3863807 

0.70 

-  7.7288332 

-  7.7280092 

0.72 

-  8.1145258 

-  8.1138344 

0.74 

-  8.5414162 

-  8.5409737 

0.76 

-  9.0054874 

-  9.0054045 

0.78 

-  9.5018768 

-  9.5022497 

0.80 

-10.0253372 

-10.0262442 

0.82 

-10.5705452 

-10.5720444 
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Example  5 

Problem:  Determine  the  element  values  of  a  fourth-order  low-pass 
filter  whose  frequency  response  approximates  the  response  of  a  fourth- 
order  Bufterworth  filter  using: 

(a)  ideal  elements 

(b)  inductances  with  nominal  resistance  of  0.01  ohns 

(c)  inductances  with  nominal  resistance  of  0.5  ohms 

Solution:  The  circuit  selected  is  the  same  as  in  Fig.  III-3  but 

there  are  series  resistors  with  the  inductances  when  non-ideal  elements 
are  considered.  The  initial  guess  for  the  elements  is  the  same  for  all 
three  situations.  All  parameters  for  DIRECT  remain  the  same.  The 
frequency  range  is  from  0.1  Hz  to  0.3  Hz,  comparing  21  points.  The 
results  are  shown  in  Table  III-7.  Figure  III-7  is  a  comparison  of  the 
frequency  responses  for  circuits  with  ideal  and  non-ideal  elements. 

Discussion:  For  nominal  resistances  of  0.01  ohms  the  element  values 
did  not  change  much  from  the  values  of  the  ideal  elements  since  the 
resistances  are  so  small.  When  the  resistance  is  of  the  same  order  of 
magnitude  as  the  inductance  then  the  final  element  values  differ  con¬ 
siderably  from  the  ideal  element  values.  Also,  with  non-ideal  elements 
the  frequency  response  as  shown  in  Fig.  III-7  is  attenuated  at  the  lcw- 
frequency  end. 
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FREQ  (Hz) 
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Fig.  III-7  Response  of  Ideal  and  Non-ideal  Circuits 


TABLE  III-7 


Ideal  Element  Values 

R  -  0 
s 

Ll  -  1.53 
C2  *  1.58 

Lj  -  1.08 

C,  -  0.383 
4 


Non- ideal  Element  Values 


R  *  0.01 
s 

Lx  -  1.51 
C2  -  1.59 
Lj  -  1.09 
C  -  0.386 

4 


R  -  0.5 
s 

Lx  -  1.11 
C2  -  1.31 
-  1.53 
C4  -  0.215 
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IV.  SUMMARY  AND  CONCLUSIONS 


The  subject  of  computer-aided  design  by  optimization  techniques, 
although  only  on°  facet  of  computer-aided  design,  is  in  itself  quite 
a  diverse  field.  There  is  a  large  variety  of  optimization  methods 
which  .1  be  effectively  employed  in  network  design.  The  main  reason 
for  using  an  optimization  technique  instead  of  a  classical  synthesis 
technique  in  circuit  des_gn  is  that  classical  techniques  cannot  satisfy 
all  possible  design  specifications.  A  specification  such  as  matching 
the  response  of  a  circuit  to  some  desired  response  given  by  a  table  of 
values  or  a  graph  cannot  be  realized  by  classical  techniques.  Con¬ 
straints  on  circuit  element  values  generally  cannot  be  accoranodated 
by  classical  methods.  Such  design  specifications  which  cannot  be 
realized  by  classical  methods  can  often  be  satisfied  by  optimization 
techniques . 

A.  SUMMARY 

Chapter  I  is  an  introductory  chapter  presenting  a  general  discussion 
of  computer-aided  design  and  application  of  optimization  techniques  in 
computer-aided  design.  The  three  basic  categories  of  opt imization 
techniques  are  described  and  the  general  nature  of  the  problem  is 
presented . 

In  Chapter  II  the  optimization  program  is  described.  The  optimi¬ 
zation  program  used  *'s  a  combination  of  the  linear  network  analysis 
program  by  Calahan  and  the  pattern-search  technique  for  minimization 
of  a  function  of  several  variables.  Modifications  to  the  original 
analysis  program  were  made  in  order  to  incorporate  it  into  the 
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optimization  program.  Basically  this  was  a  matter  of  reducing  the 
size  of  CALAHAN,  since  only  the  portion  perraining  to  frequency 
response  was  required.  The  specific  method  of  pattern  search,  DIRECT, 
in  conjunction  with  the  modified  version  of  CAIAHAN  constitute  the 
optimization  program. 

The  specific  details  regarding  the  implementation  of  the  optimi¬ 
zation  program  are  included  in  Chapter  III.  Instructions  for  coding 
of  input  data  cards  are  shown  as  a  coding  flowchart  in  Fig.  III-l. 

The  factors  affecting  the  accuracy  of  the  program  are  shown  by  the 
data  o:  Table  III-l.  A  comparison  of  the  accuracy  of  the  program  for 
the  worst  and  best  approximations  over  a  series  of  trial  runs  is  shown 
in  Table  III-l  and  Table  III-3.  Five  design  examples  are  provided  at 
the  end  of  the  chapter. 

B.  CAPABILITIES  AND  LIMITATIONS  OF  THE  PROGRAM 

Fcr  the  designs  attempted,  results  indicated  that  the  optimization 
program  is  highly  accurate  and  relatively  fast.  A  comparative  study 
between  the  gradient-projection  method  described  in  the  Naval  Post¬ 
graduate  School  thesis  by  Major  C.  A.  Henry,  and  the  pattern-search 
method  was  conducted  to  determine  the  relative  accuracy  and  speed  of 
the  two  methods.  Examples  2,  4,  and  5(a)  in  Chapter  III  were  selected 
for  the  comparisons.  The  results  are  shown  in  Table  IV- 1.  Very 
accurate  results  can  be  achieved,  as  shown  by  Example  4  in  Chapter 
III.  On  the  other  hand,  results  may  deviate  considerably  from  what 
is  desired,  as  illustrated  in  Example  3  in  Chapter  III.  A  high  degree 
of  accuracy  can  be  achieved  if  the  circuit  configuration  chosen  is  the 
proper  one  for  the  desired  response.  At  present  there  is  no  known 
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optimization  program  that  automatically  alters,  the  configuration  of 
the  network  to  yield  an  optimum  solution. 

TABLE  IV- 1 


Design  Problem 

Method 

Function 

Value 

Execution 
Time (sec) 

Straight-Line 

Gradient  Projection 

1.S55 

132 

Approx. 

patte’"  '  Search 

1.651 

50 

Fifth-Order 

Grandeur  Projection 

0.458xl0“2 

133 

Butterworth 

Pattern  Search 

0.204xl0‘5 

49 

Gradient  Projection 

0.564xl0*4 

328 

Band  Pass 

Pattern  Search 

0.220xl0~5 

184 

One  of  the  main  limitations  of  the  optimization  program  is  that 
an  excessive  execution  time  is  required  for  circuits  with  more  than 
12  or  13  elements.  The  reason  for  this  is  that  CALAHAN  finds  the  tree 
for  the  network  each  time  the  elements  are  perturbed.  This  is  not 
necessary  since  the  circuit  configuration  remains  the  same  throughout 
the  optimization  process;  however  no  attempt  was  made  to  alter  this. 

The  total  memory  requirements  for  the  program  are  approximately 
110  K  bytes.  This  may  or  may  not  present  a  problem  depending  upon 
the  computer  system  available  to  the  circuit  designer. 

C.  FUTURE  REFINEMENTS 

Possible  areas  in  which  the  program  may  be  improved  or  imple¬ 
mented  are : 

(1)  Modification  of  the  tree-finding  process  so  that  the 
tree  is  found  only  once  for  each  circuit  configuration. 


(2)  Use  of  the  program  to  optimize  active  networks. 

(3)  Development  of  a  means  to  "grow"  elements;  i.e.  development 
of  a  technique  that  will  change  the  circuit  configuration.  In  this 
manner  the  circuit  configuration  as  well  as  optimum  element  values 
would  be  calculated. 
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c 
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A  NETWORK  OPTIMIZATION  PROGRAM 


A  COMBINATION  OF  THE  CALAHAN  LINEAR  NETWORK  ANALYSIS 
PROGRAM  AND  THE  DIRECT  SEARCH  MINIMIZATION  PROGRAM 
FOR  THE  SOLUTION  OF  CIRCUIT  DESIGN  PROBLEMS 

MAIN  PROGRAM 

EXTERNAL  FF 

DIMENSION  MP(!00,3)  ,ML ( 5C ,5 ) , EL T( 100 ) ,MAP (20 ,5 1 , ELTA 
( 20  )  ,VAL ( 100 ) , VAL  A( >0),CC50),G( 501 ,H! 501 .Yll( 60) ,Y12 
(60) ,Y(  60 ,Z(6C) ,Y21(60) ,Y22(60) ,VALL(50),ZZI60,2),D 

f  irr  i.R?t  innt.DOfAn.7i  .  riii  i  r»  .hi  m  a i 


10 

11 

12 


?( ICC ).P2( 100),PP(60,2) ,BU(15) ,BL(15) 

DIMENSION  LABEL (20) 

COMMON  VAL ,OMGMI N, OMGMAX, Y, R2 , D,ELT , ELTA, VALA, Yll ,Y12, 
1VALL ,Y21,Y22,Z,ZZ,  PP» L INtNOM * JP ,  JZ , KEYl ,ND,NPL,NN, JI , 
2KI  »J0»K0,NAL»KEY2»  MP,  MAP,  JW  j ^VAR»KEY3»  NRES 
REAL  IHC  /  4HC  / 

CL()CK=ITIME(0)*.01 
RE AO (5, 11, END=26)  LABEL 
FORMAT (2CA4) 

WRITE  (6,12)  LABEL 
FORMAT  (1H1,10X,2CA4) 

REAP, PRINT  RLC  ELEMENTS 

READ(5,13)NPL»NAL,NN, JI.KI, JO,KO,(MP( J,l)yMP( J,2),ELT 
1( J),VAL( J) ,J=1.NPL) 

13  FCRMAT(7(I2,lX)/( 12 , IX , 12 , IX, A1 , IX, F10.0) ) 

WRITE(6 ,14  ) 

14  FGPMAT( //, 10X, 19HC IRCUIT  INPUT  DATA  ,//l 

lELT(J)tvAL(  J)  J  =  1ANPLI>  ’  JI  *KI  *  J0  * K0 *  4  MP «  J  *  1  »'*p<  J»2,» 

15  FCPMAT (9X,7(ll,rXf/(9XtI2,lX,I2,lX,Al,lX,F18«9l) 

IF  ACTIVE  ELEMENTS, READ  AND  PRINT 
IF (NAL) 16,19,16 

J7  ’  * (MAPI J, I ) , 1=1,4) ,ELTA( J) ,VALA( J) , J=l ,NAL) 
FORMAT (4(1 2, 1X),AI,IX,F10.0) 

i  J* 1  *  •  I-l  »EL™  J»  ,VALA(J)  ,  J=1 ,  NAL  1 

1 CRMAT (9X,4{ I2,1X),A1, 1X,F18.9) 

Y 1  "1 
KEV2=2 
KEY3=1 
NVAR=0 
NVAL=C 

REA0(5,2C ) LIN, NOM,OMGM IN, OMGMAX 
FORMAT! II, IX, I 3/2F 10,0 ) 

NO  INCLUDES  THE  STARTING  POINT 
NC=NCM*1 

D(I)  IS  THE  DESIRED  FREQUENCY  RESPONSE 
READ(5,21)(0(I ) , 1=1 ,ND ) 

FORMAT (F15. 7) 

JW=1 

NRES  IS  THE  NUMBER  OF  CONSTANT  ELEMENTS 
NFX  IS  THE  NUMBER  OF  VARIABLE  ELEMENTS 
RE AD ( 5, 22)  NRES,NEX 
FORMAT (2 15) 

RE AD (5, 23) DEL, RHO, DEC,MAXEV 
FORMAT ( 3F1 5*7, 1 5 ) 

BU (  1 )  IS  THE  UPPER  BOUND 
HL(I)  IS  THE  LOWER  BOUND 
READ(5,24) (BUI I),BL(I),I=1,NFX) 

FORMAT (2F15.7) 

NPM=NPL-NRES 

CALL  9IRECT(val»npm»sps*»dee»rho,dec,fe,kon,maxev,-i, 

1 HU  t dL I 

KEY1=2 


16 

17 

18 
19 


20 


21 


22 

23 


24 
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WRITE(6,25)  CLOCK 

25  FORMAT (IX* ‘EXECUTION  T IME=*  »  F7. 2,  *S £(•'»/) 
GO  TO  10 

26  STOP 
ENC 


SUBROUTINE  DIRECT 


TC  LOCATE  A  MINIMUM  OF  A  FUNCTIONS*  OF  K  VARIABLES 
BY  THE  METHOD  OF  DIRECT  SEARCH  (HOOKE  AND  JEEVES  1 


DESCRIPTION  OF  PARAMETERS 

PSI  IS  THE  VECTOR  OF  K  INDEPENDENT  VARIABLES.  IT  IS 
INITIALLY  FILLED  BY  USER  WITH  FIRST  GUESS  OF  SOLUTION 
AT  EXIT  FROM  DIRECT  IT  CONTAINS  BEST  VALUES  ATTAINED. 

K  IS  THE  NO.  OF  INDEPENDENT  VARIABLES  OF  THE  FUNCTION, 
S, TO  BE  MINIMIZED 

SPSI  AT  EXIT  FROM  DIRECT  CONTAINS  SMALLEST  S(PSI) 
ATTAINED 

OELCAP  IS  THE  INITIAL  STEP  LENGTH 

DELCAP  IS  ALTERED  BY  DIRECT.  DO  NOT  USE  A  NUMERICAL 
VALUE  IN  THE  CALLING  LIST 


RFO  IS  THE  STEP  REDUCTION  FACTOR 
ARE  .125  OR  .25 


SUGGESTED  VALUES 


DFLLC  IS  THE  TERMINATION  CRITERION  WHEN  THE  CURRENT 
STEP  SIZE  IS  LESS  THAN  DELLC  THE  SEARCH  IS  ENDED. 

S  IS  THE  NAME  OF  THE  EXTERNAL  FUNCTION, SC  PHI  I , TO  BE 
MINIMIZED.  A  FUNCTION  SUBPROGRAM  OF  THE  SAME  NAME 
MUST  BE  SUPPLIED  BY  THE  USER 


KONVRG 

KCNVRG 


KCNVRG 

KCNVRG 

NUMBER 


IS  AN  INDICATOR  TESTED  UPON  EXIT  FROM  DIRECT. 
*-l,A  PARAMETER  ERROR  WAS  DETECTED. 

K.GT.15  OR  K.LE.O, 

DELCAP. LE.O. 

RHO.LE.G  Oft  RHO.GE.l. 

=0»MAXEV  WAS  EXCEEDED. MINIMUM  WAS  NOT  FOUND 
GREATER  THAN  ZERO  THEN  THIS  NUMBER  IS  THE 
OF  EVALUATIONS  OF  THE  FUNCTION, 


MAXEV  IS  THE  MAX.  NO.  OF  EVALUATIONS  USER  ALLOWS 
TC  FIND  THE  MINIMUM. 

KN  IS  AN  INDICATOR  USED  TO  08TAIN  OUTPUT 
KN=-1  OUTPUT  OF  FUNCTION  VALUE  AND  VARIABLES  IS  MADE 
AT  ORIGIN, AFTER  EACH  EXPLOPE  MOVE, AFTER  EACH  PATTERN 
MOVE,  AND  AT  EXIT. 

KN=0,  HO  OUTPUT  BY  DIRECT 

XN=l ,S AME  AS  FOR  - 1  EXCEPT  EXPLORE  MOVES  ARE  OMMITEO. 


SUBROUTINE  DIRECT  (X, K, SPSI, DELCAP, RHO, DELLC, S, KONVRG, 
1MAXEV, KN,BU,0L I 

DIMENSION  /.  (50),PSI(15),PHI(15), SLC ( 15),X(15),BU(15) 
1,61(15) 

INTEGER  EVAL 
DO  100  1=1, K 
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ico  psim=xm 


c 

c 


I F ( K «GT .15 I  GO  TO  50 
IF  C  K  >  50,50,4 

4  IF<DEtCAP|  50,50,5 

5  If(BHO)  50  »  50, 6 

6  IFIRHO.GE. 1. 1  GO  TO  50 
IF<DELLCI  50,50,7 

7  MAXEVL  =  MAXEV 
IF(MAXFVL)  3,8,9 

8  MAXEVL  =  500 

9  OC  60  1=1, K 

60  St  Cl  I »  =  OELCAP 
SPSI  =  S(PS!I 
EVAL  =  1 


61 

63 


62 

1 

10 


11 

12 

14 

13 

2 


IF(KN)  61,1,61 

WRITE  <6.631  DELCAP,RHO,DELLC,MAXEVL,KN,U,I 
FOPMAT  < 14H1DIRECT  SEARCH, 2X, 8H0ELCAP=,E15.6 
1  =,E15.6,2X,7H0ELLC  =,E15.6 ,2X, 8HMAXEVL  =  ,IS 
2= , I 3//8H0  MOVE  ,15H  FUNCTION  VALUE ,3X,3X. 12 
34X,3X, I2.6HN0  VAR, 4X,  3X,I2,6HRD  VAR,4X,3(3X 
4  VAR, 4X1/  26X,6(3X,I2»6HTH  VAR, 4X1 /26X,6 ( 3X, 
5R.4X11 

WRITE  <  6,621  SPSI,  <PC I < 1 1 , 1=1 ,K> 

FOPMAT <  8HCCR IG l N  , E15. 7 ,3X ,6E15.6  /C26X.6E15 

SS  =  SPSI 
DC  10  I =1 , K 
PHI <  I )  =  PSIUI 
ASSIGN  11  TO  IBK 
GO  TO  40 

IF  (KNI  12,13,13 

WPI'E  <  6,141  SS, <  PHI U 1 , I =1 ,K1 

FORMAT  < 8HC  EXPLORE, E15»  7, 3X» 6E15* 6  /<26X,6E15 

IF ( SS*GE«SPS 1 1  GO  TO  3 
IF  <EVAL.GE. MAXEVL  I  GO  TO  51 


21 

22 

23 


20 


DO  20  1=1. K 
IF<SLC< I ))  21,50,22 
iF<pHi<n.GT.psimi  slcui  =-slc<ii 

GC  TO  23 

iFipHim.Lr.psimi  slcui  =  -slcui 

THET  =  PSIIII 
PSIUI  =  PHI  <  1 1 
PHI <11  =  2.*PHI(I)  -  THET 
PHI < I I=AMIN1 <PHI <11 ,BU< I ) S 
PH I ( 1 1 =  AMA  X1<PHI< 1 1 , BL  < II  I 
CONTINUE 

SPSI  =  SS 
SPHI=S<  PHI  1 
SS=SPHI 

EVAL  =  EVAL  *1 
ASSIGN  25  TO  I3K 

40  OC  41  1*1, K 
THET  =  PHI < 1 1 
SLCI  =  SLCUI 
PHI  < II  =  THET  ♦  SLCI 
PHI U I =AMI N1 <  PH I < 1 1 , BU  < 1 1  1 
PHI< I)=AMAX1 (PHI <1 1 ,BL< 1 1  I 
SPHI  =S  <PH 1 1 
EVAL  =  EVAL  +1 
IF<SPHI.LT.SS1  GO  TO  42 
PH 1 < I I  =  THET  -  SLCI 
PHi <I)=AHA XI (PHI U 1,BL<I1I 
PHI < I 1= AMIN1 (PHI <I1,PU(I)1 
SPH!=S<  PHI  I 
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=  i,KI 
, 2X, 5HRH0 
,  2X.5H  KN 
, 6HST  VAR, 
,I2,6HTH 
I2.6HTH  VA 


•  6)1 


•  61  1 


nnnnn 


FVAL  *  £  VAL  +1 
IF(SPHI.GE.SS)  GO  TO  44 
SIC ( 1 1 =-SLC I 
42  SS=5PHI 
GC  TO  41 
44  PHI ( I i =THE  T 
41  CONTINUE 

GO  TO  I  BK, ( il ,2 5) 

25  IFCKNI  27*28,27 

27  WRITE!  6,29)  S S, ( PHI ( 1 1  ,1 =1 , K) 

29  FORMAT  ( 8H  PATTERN, E15. 7, 3X , 6E 15. 6  /( 26X,  6E 15.  6H 

28  IF ( SS.GE.SP SI )  GO  TO  1 
00  26  1=1. K 

IFIABSIPHl  (  il-PSI(I)l.GT.0.5*ABS(SLC( I)  ))  GO  TO  2 

26  CONTINUE 

3  IF  (DELCAPi  LT.OELLC )  GO  to  52 
DELCAP  =  RHO  *  OELCAP 
00  30  1=1, K 

30  SLcm  =  rho  *  sicm 

GO  JO  1 

50  KCNVRG  =  -1 
GO  TO  53 

51  KONVRG  =  0 
GO  TO  53 

52  KONYRG  =  EVAL 

53  IFIKHI  55,54,55 

55  WRITE!  6,56)  KONVRG, S?SI , (PSI II ) , I =1 ,K ) 

56  FORMAT ( 1CH0K0NVRG=  .IJ0/8H  EXIT  ,E15.7,3X.6E15.6/ 
1  i  26X ,6E 15. 6 ) ) 

54  RETURN 
END 


FUNCTION  FE 


FUNCTION  FE(X) 

DIMENSION  VAL ‘ 100  i  , X( 100 I  *D( 100  ) * Y (60 ) , Z ( 60) ,R2( 100 ) , 
I.MP(  IOC,  3)  ,  ML(  50,5) .ELT(  1001  .MAP  (20,5 )  , tLTA(20  1 . VALA(20 
2)»C(50)»yI1(60I»Y12(60)»Y21(60) , Y22( 60) , VALL ( 5u) , 
322(60,2) ,PP(60,2I 

COMMON  VAL.OMGMIN,OMGMAX,Y,R2,D,ELT,ELTA,VALA,Y11,Y12, 
1VALL ,Y2i ,Y*2 , Z, 22, PP.L IN.NOM, JP , JZ»  KEY1 , NO,NPL»NN, JI , 
2KI , J0,K0,NAL,KEY2,MP,MAP,JW,NVAR,KEY3,NRES 
NPM=NPL-NRES 
DO  2  J=1 ,NPM 
2  VAUJ)=X(JI 

CALL  1  Or  OL ( NPL.NAL , NN , J I , KI , JO , KO  • 3  ,KEY2 »MP*  ELT , VAL , 
IMAP, ELT  A.VALA.Tll, V12, VALL, JW.NVAk ,KE Y3, Y*  Nr , Jll ) 

CALL  TOPuL ( NPL , NAL , NN,JI,KI , JO, K0,2 ,KEY2 , MP, ELT , VAL , 
IMAP, ELTA,VALAfY21, Y22, VALL, JW,NVAR,KEY3,2,NZ, J22) 

00  14  J=l,60 
IF(Y(1) 16,4,6 
4  IF ( Z ( 1 > )6, 8,6 
6  JP=NP- J^l 
jz=Nz-m 
GO  TO  16 
8  00  10  K=1 *  NP 
10  Y(K)=Y(K+1) 

DO  12  K=l, N2 
12  2  ( K )  =2  ( K+ 1 ) 

14  CONTINUE 
16  CONTINUE 

00  20  J=1 ,60 
JJ=JP~J*1 
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p  t 


c 

c 

c 


IF  mjJH16y20f  18 
13  JP=JP-J*1 
GO  TO  22 
20  CONTINUE 
22  DO  26  J  =  1 »  60 
JJ=JZ-J*1 
IF  ( Z '  )J)  »24,26t24 
24  JZ=J/-J*1 
GO  T]  28 
26  CONT INUE 

CALCULATE  ZEROS 
2 a  CALL  MULLERfY, JP»ZZ) 

CALCULATE  POLES 
CALL  NULLER (Z» JZtPPI 
CALCULATE  FREQUENCY  RESPONSE 

CALL  FREQQILINtNOHf OhGMINt OMGMAXt JP» JZtY*ZfK£YltR2l 
FE=0  . 

DO  1  1=1, NO 
FE=FE+<P2<  IJ-D<  IH**2 
RETURN 
END 
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